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RECURRENCE OF EDGE-REINFORCED RANDOM WALK ON 
A TWO-DIMENSIONAL GRAPH 

By Franz Merkl and Silke W. W. Rolles 

We consider a linearly edge-reinforced random walk on a class 
of two-dimensional graphs with constant initial weights. The graphs 
are obtained from by replacing every edge by a sufficiently large, 
but fixed number of edges in series. We prove that the linearly edge- 
reinforced random walk on these graphs is recurrent. Furthermore, 
we derive bounds for the probability that the edge-reinforced random 
walk hits the boundary of a large box before returning to its starting 
point. 

1. Introduction. In his paper [10], Pemantle studies recurrence and tran- 
sience of a linearly edge-reinforced random walk on trees witii a parameter 
A > 0. At the end of this paper, he writes: "Questions of reinforced random 
walk on other graphs are still wide open. Diaconis originally asked me about 
the d-dimensional integer lattice Z'^. I believe it is not even known whether 
there is a A > for which the reinforced random walk on 7? is recurrent!" 

This turned out to be a hard problem which is unresolved. However, 
in this article, we solve a variant of this problem. For a class of fully two- 
dimensional translationally symmetric graphs and sufficiently small constant 
initial weights, we show that the edge-reinforced random walk visits every 
vertex infinitely often with probability one. This is the first time that re- 
currence of the linearly edge-reinforced random walk is proven for a fully 
two-dimensional graph. 

Comparison with previous work. Earlier versions of the technique pre- 
sented here have been used in [7] to prove recurrence for the edge-reinforced 
random walk on a large class of one-dimensional reflection-symmetric peri- 
odic graphs, including, among others, Z x {1, . . . , d} for d € N. The technique 
can be also used to prove some bounds for the random environment corre- 
sponding to the edge-reinforced random walk on ; see [9] . 
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Given a graph G, its r-diluted version is the graph obtained from G by 
replacing every edge by r edges in series. The basic new idea of the present 
paper is that this dilution of a graph makes recurrence simpler to prove: 
Already a simplification and generalization of the techniques from [9] to 
diluted two-dimensional graphs suffices to prove recurrence. 

For a more detailed comparison of previous papers with the present work, 
we refer the reader to the concluding remarks in Section 10. An overview 
of earlier work on the linearly edge-reinforced random walk can be found in 
[6]. For a recent overview of general processes with reinforcement, we refer 
the reader to [11]. 

Definition of linearly edge-reinforced random walk. Given r G N, we con- 
sider the graph Gr = iVr^Er) with vertex set 



Here \x\ denotes the Euclidian norm of x. Note that the edges are undirected. 
A finite piece of Gr for r = 4 is shown in Figure 1 . 

Let := (0,0). The linearly edge-reinforced random walk (ERRW) on Gr 
with constant initial weights a > and starting point is a stochastic process 
{Xt)t&io with law Pq'^ defined as follows: At every discrete time t € No, every 
edge e € -Er is assigned a strictly positive number wt{e) as a weight. Initially, 
all weights are equal to a: 

(1.3) WQ{e) = a for all e G £'r . 

The edge-reinforced random walker starts in the vertex at time 0: 




{(xi, X2) G : G rZ or X2 G rZ} 



Er = {{u, v} C Vr ■.\u — v\ = 1}. 



(1.4) 



Po':a[^0 = 0]=l. 




Fig. 1. A finite piece of the graph Gi. 
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At each discrete time t G Nq, the random walker jumps randomly from its 
current position Xt to a neighboring vertex v with probability proportional 
to the current weight of the connecting edge {Xt,v}: 

(1-5) Po,a[^t+l=v\ Xo,Xi,...,Xt] = }^ ,A {{Xt,v}(^Er}- 

The weight of the traversed edge is immediately increased by 1, whereas all 
other weights remain unchanged: 

(1.6) wt+i{e) = wt{e) + l{{Xt,Xt+i}=e} foraheS^;,-- 

Thus, the weight of edge e at time t equals the initial weight increased by 
the number of times the reinforced random walker has traversed e up to 
time t: 

t-i 

(1-7) wt{e) = a + J2h{Xs,x,+i}=e}- 

s=0 

We call a path {vo,vi,V2, . . .) in a graph admissible if {vt-i,vt} is an edge in 
the graph for all t € N. We realize Pq^ as a probability measure on the set 
S C T/f^o of admissible paths in Gr, not necessarily starting in 0, endowed 
with the (T-field generated by the canonical projections : S ^ V^, t G Nq. 

Main results. We prove the following: 

Theorem 1.1 (Recurrence). For all r e N with r > 130 and all a G 
(0, (r — 129)/256), the linearly edge-reinforced random walk on Gr with con- 
stant initial weights wo = a visits all vertices infinitely often with probability 
one. 

Note that small initial weights a correspond to strong reinforcement. This 
can be seen more intuitively by taking the initial weights equal to one, but 
the weight increment at each time step equal to 1/a, which defines the same 
law of the random walk. In this sense, the recurrence result applies to strong 
linear reinforcement. 

In order to prove recurrence, we derive bounds for the probability that 
the edge-reinforced random walk hits the boundary of a large box before 
returning to its starting point. Let us introduce some notation before we 
state the result: For AQV,., let 

TA.= mf{t>l:XteA} 

be the hitting time of A. If A = {v} contains just one vertex, we simply 
write Ty instead of T|,„} . Let 

(1.8) L^:=rZ^ 
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be the set of "four- way-crossings" in the graph Gr- For (^1,^2) S Vr, set 
|(t'i,U2)|oo := max{|t;i|, \v2\}. 
We prove the fohowing: 

Theorem 1.2 (Hitting probabiUties). For allr e'N with r > 130 and all 
initial weights a € (0, (r — 129)/256), there exist constants Iq = lo{r,a) € N 
and 1^ = i^(r, a) > 0, such that the following hold: 

(a) For all i £ Lr with |£|oo > ^o? probability that the edge-reinforced 
random walker hits i before returning to its starting point satisfies 

(b) As a consequence, for all I >lo, the probability that the edge-reinforced 
random walker hits a vertex in the set Vi := {v Vr : \ v\oo = rl} (i.e. a 
vertex in the intersection of Vr with the boundary of the box [—rl,rl]'^) 
before returning to can be bounded as follows: 

(1.10) Pg'a[rv,<To]<8r^. 

Notation. For a,b £M, set a Ab = min{a, b} and aV b = max{a, b}. Let 
[aj denote the largest integer < a, and let [a] denote the smallest integer > 
a. The cardinality of a set A is denoted by |^|. For two probability measures 
P and Q on the same space, P <^Q denotes that P is absolutely continuous 
with respect to Q. 

2. Main lemmas and global structure of the paper. All the theorems in 
Section 1 rely on the bound (1.9) of the hitting probabilities. The main work 
in this paper is required to prove this bound. 

Finite boxes with periodic boundary conditions. The bound (1.9) is based 
on an analysis of the edge-reinforced random walk on finite boxes with 
periodic boundary conditions, in the limit as the box size goes to infinity. 
We now introduce these finite boxes and some related notation. 

Given r G N and i S N with i > 1 , we define a finite variant Gr = 
{Vr^\Er^) of Gr with periodic boundary conditions as follows: Set 

(2.1) V;(*) :={v + riZ^:veVr}^Z^/{riZ'^), 

(2.2) ■.= {{u + riZ'^,v + riZ'^}:{u,v}eEr}. 

(i) 

Whenever there is no risk of confusion, we identify Vr with its set of 
representatives 

(2.3) V;(*) := {{vi,V2) G Vr:r[i/2\ - ri < vj < r[i/2j for j = 1,2} C Vr- 
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Furthermore, we identify the subset 

(2.4) E^^ := {{u + ril?, v + riZ^} : {u, v} € Er, u,v e V^^'^ } C E^.'^ 
with its set of representatives 

(2.5) ^« := {{u, v} £Er:u,ve V,^^} C Er. 

Note that the inclusion in (2.4) is strict. We call all edg es in Er^ \ Er'^ pe- 
riodically closing edges. For instance, the edge {(r[i/2j,0) +r«Z^, {r[i/2\ — 
ri + 1,0) -\-ri7?} is periodically closing as it is contained in Er \ but not in 

H/r ■ 

Figure 2 illustrates the graph {Vr^\Er'^) for r = i = 4. 
Finally, we set 

(2.6) 4*^ := {v + riZ^ : v S L,.} C 

(i) (i) 

Thus, Lr consists of the vertices in Gi- of degree 4. 

To prove our main results, we analyze the edge-reinforced random walk 

(i) 

on the finite boxes G)- with a constant initial weight a > 0. 

Linearly edge-reinforced on finite graphs. Since most parts of our argu- 
ments are quite robust, we work in this section with the edge-reinforced 
random walk on a general finite connected undirected graph G = (V, E) 
with possibly edge-dependent initial weights Og > 0, e ^ E. In Section 8, we 

(i) 

specialize to the case G = Gr . 

The edge-reinforced random walk on a finite graph G = {V, E) is defined 
in analogy to the definition on Gr given in the Introduction. Given a start- 
ing vertex vq^V and initial weights a= {ae)e&E-, it is a stochastic process 



6 F. MERKL AND S. W. W. ROLLES 

{Xt)t&^Q taking values in V with law a, specified by 

t-i 

(2.7) wt{e) = ae + Y.l{{x.,x.+^}=e} {e€E,teNo), 

s=0 

(2.8) P„^jXo = t;o] = l, 

pG -,,\Y y wt{{Xt,v}) , 

^voM^t+l - V I Ao, Ai, . . . , AjJ - — T^^iiXtM'^E} 

(2.9) 

(wGF,t GNo). 

Again, we realize -P^^a ^ probability measure on the set Sg ^ of 
admissible paths in G, not necessarily starting in endowed with the cr- 
field generated by the canonical projections Xt : Sg -^V,t£ No- 

ERRW as a mixture. It is known that this edge-reinforced random walk 
on the finite graph G is a mixture of reversible Markov chains with a unique 
mixing measure. Let us review this result. Let O = (0,oo)'^ be the space of 
strictly positive edge weights on G. For x = {xe)eeE G ^ and v £V, define 

(2.10) Xy := J2 

eeE: 

For vq E:V, we denote by Qvo,x the distribution of the Markovian random 
walk on G which starts in vq and jumps from u to a neighboring point v with 
probability proportional to the weight Xe of the connecting edge e = {u,v}: 

(2.11) QvoA^o = vo] = l, 

(2.12) Qi,^^.:t:[Xt+l = V I Xo,Xi, ...,Xt] = -^—^lssXt,v}(£E} 

XXt 

(vGF,t GNo). 

Fix a reference edge cq G E. At this point, the edge cq is arbitrary, but 
from Section 5 onward, it will be convenient to assume fo G cq. We introduce 
the set of weights 

(2.13) neo:={xen:Xeo = l} 
having the weight of the reference edge cq normalized. 



Lemma 2.1 (Mixture of reversible Markov chains. Corollary 3.1 of [12]). 

For all vq ^V, a G (0, cxd)^, and cq G E, there exists a unique probability 
measure Q^^a,eo ^eo with the following properties: The distribution P^^^ 
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of the edge-reinforced random walk on G starting in vq with initial weights 
a satisfies 



for all events A C Eg of admissible paths in G. 
We call Qj^j the ^^mixing measure.''^ 

The proof of this lemma in [12] is based on a de Finetti theorem for 
reversible Markov chains, which relies on a de Finetti theorem for Markov 
chains by Diaconis and Freedman [2]. 

The main lemma — concrete version. All theorems of this paper are based 
on a lemma, which we phrase in this section and prove in the subsequent 
sections. There are two versions of this main lemma: a "concrete" version, 
which works with finite boxes with periodic boundary conditions and con- 
stant initial weights, and an "abstract" version working with general finite 
graphs and general initial weights having a reflection symmetry. The con- 
crete version is a consequence of the abstract version. 

For the edge-reinforced random walk on gI*^ with constant initial weights 
a = (oe = a)^g^{i), starting point 0, and reference edge eo = {0, (0, 1)}, we 
denote the mixing measure from Lemma 2.1 by 



The initial weight a is omitted from the notation because it is fixed through- 
out the paper. 

Roughly speaking, the concrete version of the main lemma bounds in a 
stochastic sense the ratio of two vertex weights and xq with respect to the 
mixing measure Qq^. For i G L^, let io{i) € N be large enough that, for all 
i ^ ^o(^)) the vertex £ belongs to Vr'^^ and has vertex degree 4 in the graph 



Lemma 2.2 (Main lemma — concrete version). Let r S N with r > 130 
and let the initial weight satisfy a S (0, (r — 129)/256). There exist constants 
Iq = loi^jC-) S N o-i^d C = C(^)O) > 0, such that, for all i £ L,. with > Iq 
and i > ioi^), the following estimate holds: 



(2.14) 




(2.15) 




(2.16) 
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The main lemma — abstract version. The abstract version of the main 
lemma works with a general finite connected graph G = {V, E) with arbitrary 
initial weights a€ (0,cxd)^. The weighted graph (G, a) needs to have an 
additional reflection symmetry, which we introduce now. 

We call a bijection f :V ^ V on the vertices an automorphism of the 
weighted graph (G,a), if the following hold: 

• For all u,v (zV, one has {fiu),f{v)} S if and only if {u,v} € E. 

• The edge weights are preserved: = holds for all {u,v} G 
E. 

We extend / to the set of edges as follows: /(e) = {f{u),f{v)} for e = 
{u,v} € E. 

In the abstract version of the main lemma, the vertices and i from the 
concrete version are replaced by two vertices vo,vi€V with the following 
symmetry property: 

Assumption 2.3. We take two vertices vq,vi (zV, a reference edge cq G 
E, and a function ip: E ^ [0, 1], and we assume the following: 

(a) The vertices vq, vi satisfy vq^vi, and vq is not adjacent to vi, that 
is, {vo,vi} ^ E. 

(b) The reference edge cq is incident to vq-Vq S cq- 

(c) There exists an automorphism f of the weighted graph {G,a) with f{vo) = 
vi and f{vi) = vq. 

(d) We have (p{e) = for all e € E with vq S e, and (p{e) = 1 for all e ^ E 
with vi G e. 

(i) 

Remark 2.4. In the special case of the periodic boxes Or , endowed 
with constant initial weights a, parts (a)-(c) of this assumption are satisfied 

for r > 1, Vq = 0, vi = £ £ Lr^ \ {0}, and eo = {0, (0, 1)}. In particular, the 
two vertices and £ have both four neighbors; recall Definition (2.6) of Lr\ 
In this special case, we may take / as the reflection 

(2.17) f--V^V, v^i-v. 

For v gV, set 

(2.18) a^:= ^ Oe- 

Lemma 2.5 (Main lemma — abstract version). Under Assumption 2.3, 
one has the hound 
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where 



(2.20) 



5. = E 



tti, + 1 
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This article is organized as follows. In Section 3, we review an explicit 
description of the mixing measure Q^, ^ eo from Lemma 2.1. This description 
was discovered by Coppersmith and Diaconis [1] in 1986. Later, Keane and 
Rolles [4] pubhshed a proof of their formula. Section 3 also contains some 
properties of the mixing measure, in particular, scaling properties, which are 
needed in the present paper. 

In Section 4, we interpolate between the two random environment distri- 
butions corresponding to two different starting points. We also show that 
properties of the interpolations are inherited from the scaling properties of 
the mixing measure. In particular, normalizing constants remain unchanged 
after scaling. 

Proving the bounds for the weights boils down to proving an upper bound 
for these normalizing constants; see (4.13) below. The upper bound for the 
normalizing constant is then obtained via a general variational principle, 
Lemma 5.1. This variational principle is proved in Section 5. It relies only 
on the Assumptions 2.3 for the underlying weighted graph. 

The variational principle is then applied to a deformation of the interpo- 
lated random environments. In Sections 5-7, this leads to a proof of Lemma 
2.5, the main lemma in the context of a general finite connected graph. 

In Section 8, we verify that the assumptions of the abstract version of 
the main lemma (Lemma 2.5) are satisfied for the edge-reinforced random 
walk on the boxes Gf with constant initial weights a, provided r and a are 
chosen appropriately. In this way, we deduce Lemma 2.2 from Lemma 2.5. 

Finally, in Section 9, we derive the estimates for the hitting probabili- 
ties of the edge-reinforced random walk (Theorem 1.2) from Lemma 2.5. 
Recurrence is shown using these estimates for the hitting probabilities. 

The following results from other papers are used. The present paper uses 
only a few results from our previous articles. One essential ingredient is 
Lemma 3.4, which is a variant of the formula by Coppersmith and Diaconis 
[1]. The version of this formula used in the present paper is taken from the 
Appendix of [9]. Besides this description of the mixing measure, we cite only 
a general bound for the tails of ratios of two edge weights (Theorem 2.4 in 
[8]) and the fact that the edge-reinforced random walk visits every vertex 
infinitely often with probability one if and only if it returns with probability 
one to its starting point (Theorem 2.1 of [8]). 
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3. Properties of the mixing measure. Throughout Sections 3-7, we con- 
sider the edge-reinforced random walk on a finite connected graph G with 
initial weights a G (0,oo)^. Since the underlying graph G is fixed, we sup- 
press the dependence on G in the notation. In particular, we introduce the 
following abbreviation for the mixing measure Q^^a,eo from Lemma 2.1: 

(3-1) Q.o,a,eo:=Q^ro,a,eo- 

The mixing measure Qiig,a,eo has an explicit description, discovered by 
Coppersmith and Diaconis [1, 3]. We review it in this section. This descrip- 
tion reveals a nice scaling property of the mixing measure. In order to state 
it, we need some preparations. 

Denote by 6i the Dirac measure at 1. We endow Q^o with the reference 
measure 

(3.2) peoidx) := 6i{dxeo) Yl — = h{dxeo) n d{logXe). 

e&E\{eo} eGi?\{eo} 

The measure is just the Lebesgue measure on a logarithmic scale. 
More precisely, the image of under the bijection 

(3.3) Leo:Oeo^M^\^^«>, {Xe)eeE^{logX,),^E\{eo} 

is the Lebesgue measure on M^^'t'^^J'. Given a different reference edge ei G E, 
we introduce the map 

(3.4) (jfep^ej : — > , geQ,eiix) = {X(,/Xe-i)e€E- 

It serves to change the normalization. The map geo,ei is a bijection with 
inverse 5ei,eo- 

Lemma 3.1. For all eo,ei £ E, ei, and all Borel sets A C VL^^, we 
have 

(3-5) Peo[{x ^^eo--geo,eA^) ^ A]\= PeAM- 

In words, pe^ is the image measure of peo with respect to geo,ei- 

Proof. It suffices to prove the lemma for sets of the form A = Yl^eE 
with Ae^ = {1} and Ae = {be,Ce\ for e G £" \ {ei}, where <be < Cg. Then, 
for X G OgQ, we have (7eo,ei(a^) G j4 if and only if the following hold: l/cgQ < 
< l/6eo; a^ei^e < Xe < XejCg for e G E \ {cq, ci}. Thus, the left-hand 
side in (3.5) equals 




ee£;\{ei} 
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□ 

The following function ^vo,sl plays an essential role in the description of 
the mixing measure. 

Definition 3.2. A spanning tree T of G is a maximal connected sub- 
graph of G without cycles, viewed as a set T C £' of edges. Let T de- 
note the set of spanning trees of the graph G. We introduce the map 
$i.o,a -.O.—^ {0,00), given by 

(3.7) ^.Ui-.UE) = """'"\^.+^)/^ ^/^n^e. 



X 



Lemma 3.3 (Scaling property). For all A G (0, 00) and all x = {xe)eeE ^ 
we have 

(3.8) ^^o,a(Ax) = $„(,,a(2;). 

As a consequence, for all cq, ei (z E and all x G f^eo; 

Proof. Let A G (0, cxd). Any spanning tree T has \V\ — 1 edges. 
Hence, for any x G il, we get 

(3.10) $.o,a(Ax) = A^«>„o,a(^) 

with the exponent 

(3.11) ^=E«e-^- E ^ + ^ = E«e-^E«^ = 0; 

for the last equality, we used the definition of a^. This proves (3.8). By the 
definition (3.4) of geo,ei, the identity (3.9) is just the scaling property (3.8) 
in the special case A = l/x^-^. □ 

The mixing measure from Lemma 2.1 can be described as follows: 

Lemma 3.4 (Description of the mixing measure. Lemma 9.1 of [9]). For 
all vq ^V, a G (0, 00)^, and eo G E, the distribution Q^o.a.eo of the random 
environment from Lemma 2.1 is absolutely continuous with respect to 
with the density 

(3.12) ^^^(^) = ^<^.0,a(^), 

x G Oeo, where z^^^e,^ > denotes a normalizing constant. 
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Although the distribution Q,;o,a,eo does depend on the initial weights a, 
we usually drop the subscript a, writing 

(3.13) Q^o,eo=Q^O,a,eo 

to simplify the notation, since a is being fixed. 
Lemma 3.5. 

(a) For all eo, ei & E and all measurable functions f : f^ei [0, oo], one has 

(3-14) / f{geo,eiix))<^voAx)PeQ{dx)= /(x) ^>^,o,a(x)/9ei (c^x) . 



In other words, the image of the measure ^i,g^a_dpeo on Q^o with respect 
to the map geo,ei '-^eo ~* ^ei equals the measure ^vojadpei on r^ei- 

(b) As a consequence, the normalizing constant z^^^e^ does not depend on 
the choice of the reference edge: 

(3.15) Zy^^^^Q — Z^jQ^ei- 

(c) Under Quo,eo; the scaling {xe/xei)e£E of the random environment ac- 
cording to geo,ei has the law Qt,Q,ei- 

(d) The joint laws of the family {xe/xe,Xe/xy,Xy/xi,)e,eeE,v,veV of all ratios 
of weights with respect to Qvo,eo and with respect to Qvo,ei coincide. 

Proof. Let eo,ei G E. Using first the scaling property (3.9) and then 
the transformation formula and Lemma 3.1, we obtain the claim (3.14) in 
(a) as follows: 

/ f{geo,ei{x))^voAx)peoidx) 
(3-16) = / f{geQ,ei{x))^voA9eQ,edx))peo{dx) 

f{x)^voA^)Pei{dx). 



The claim (3.15) in (b) is just the special case / = 1 of the first claim (3.14). 
Part (c) is an immediate consequence of (a) and (b), since dQ„o,eo = 

{^vo,eo) ^^vo,adpeo and dQ^g^ei = (-Ziio,ei ) ^^VQ.adpei- 

Part (d) is a consequence of part (c). To see this, take x € r^eo and y = 
9eo,eiix) G i^ei- Using the notation y^ = Y^eaE-.e^vVe for t; e F in analogy to 
Xy = X^eeEiegj; ^e, wc get the claim (d) from 



(3.17) 



/ Xg Xe Xy \ 


/Ve 


ye_ 




\Xe Xy Xy J f^^g^j^^y^jj^Y 




Vv' 


' Vv) 



□ 
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Part (b) of the lemma allows us to omit the reference edge cq in the 
normalizing constant: 

(3.18) Zyg ^^iQ^gQ. 

Hence, (3.12) can be rewritten as 

(3.19) ^^(^) = ±c^,^^,_^(^), a: en,,. 

4. Interpolation between two environments. For two vertices vo,vi G V, 
we consider an interpolation of the random environments Qvo.eo and Qi,i,eo 
associated with the edge-reinforced random walk on G with initial weights 
a and starting points vq and vi, respectively: 

Definition 4.1 (Interpolated measure). For vo,vi € V and cq G E, de- 
fine ^vo,vi,eo to be the probability measure on figo with the following Radon- 
Nikodym derivative with respect to pe,'- 

dPeo \ dpeo dpeo J 

with the normalizing constant 

(4.2) Z„„,,,:=/ ('J^'3^y'\,„. 

Jn^o ^ ^P<^o dpeo ) 

Remark 4.2. Since d^vo,eo/dpeQ and (iQtij^ ,eo /'^Peo are strictly positive 
probability densities with respect to peg, the normalizing constant Zy^^^j^-^^^eo 
is indeed strictly positive and, by the Cauchy-Schwarz inequality, it is finite. 
Hence, Pi,o,t;i,eo is well defined. 

The measure ^vo,vi,eo inherits the following invariance under change of 
normalization from Qvo,eo- 

Lemma 4.3. 

(a) The normalizing constant .^i,o,i;i,eo does not depend on the choice of the 
reference edge: 

(4.3) ^I'o.fi.eo = ^fo,«i,ei for all eo, ei G E. 

(b) The law of ge^^ei, that is, the distribution of {xe/xe^)e£E, wnder P„(,^„^^eo 
ecfitals IPijQ ,1!^ ,ei • 

(c) Consequently, the ratios {xe/xy)e£E,veV have the same joint laws under 
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Proof. Let eo, ei € E. We claim that for any measurable function / : 
[0, oo] the following identity holds: 

/(5eo,e.(x))(^^(x)^§^(x))'^'peo(rfx) 
V "Pen "Pen / 

(4.4) 

1/2 



dpeo dpeo 



To see this, we first insert the description (3.19) of the random environments 
Qt^o^eo Qvi,eo- Then, we apply the scaling invariance (3.9) of the densities, 
and finally, we use Lemma 3.1. This yields the following for the left-hand 
side of (4.4): 

1/2 



1/2 

Peoidx) 



[ /(5'eo,el(x))('-^$^,n,a(rE)--^$^,l,a(a:)) peo{dx) 
(4-5) = f /(5eo,ei(x))( -^^>^,o,a(5'eo,el(2;))-^^>^,l,a(9eo,el(2;)) 
= I f{x){ — ^voAx) — ^v,M)] PeMx), 

which equals the right-hand side of (4.4). 

The claim (4.3) in part (a) is a special case of (4.4) with / = 1. Part (b) is 
an immediate consequence of part (a) and (4.4). Part (c) follows from part 
(b) in the same way as Lemma 3.5(d) follows from Lemma 3.5(c). □ 

Part (a) of the lemma allows us to drop the reference edge eo in the 
normalizing constant: 

(4.6) Z^g^y^ = Z, 



One reason why we introduce Pi,o,j;i,eo is the following symmetry property, 
which does not hold for the random environment distribution Qvo,eo- 

Lemma 4.4 (Symmetry property of ^vo,vi,eo)- Let vq,vi G V be such 
that Assumption 2.3(c) holds. Then, for all cq € E, the ratios Xy^/x^-^ and 
Xvi/xvQ have the same law under F^^ ^^^^^eo ■ 

Proof. Let vo,vi and / be as in Assumption 2.3(c), and let eo G E. We 
claim that the two random vectors 

(4.7) (^) and (^) have the same law under W^jg^^-^^^g. 

\Xvo / e&E V Xv^ J eg_E 
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To see this, let ^ C O be a measurable set. Using the definition of ^vo,vi,eo 
and the description (3.19) of the random environment in the first step, we 
get 



1 



(4.8) 



-'Vo,Vl J^eg 



1 



Ia 



1 



X 



1 1 



-Do 



/(do) / eeE 



X 



Do 



1 

^voAi^f{e))eeE) — ^v^AiXf{e))e&E) Pf{eo)idx), 



where in the last identity we used that peo is obtained from /9/(eo) by per- 
muting the variables by rr i-^ (xj(e))ee-B- Since / is an automorphism of the 
weighted graph (G,a) with f{vi) =vq, it follows from the description (3.7) 
of the densities that 



(4.9) 



Using /{vq) =vi, one obtains in the same way <^t,j^a((2;/(e))ee-B) = 'I'Do,a(2;) 
Hence, we conclude from (4.8) 



■ Do,Di,eo 



^vo / e£E 



1 



(4.10) 



DO.Dl "'f^/Xeo) 



1 



l^Dl 



X ^Di,a(2;) $ 



-DQ 



1/2 



^Di / eei? 

Lemma 4.3(c) implies that in the last probability one can replace the refer- 
ence edge /(eo) by cq- Hence, the claim (4.7) follows. 
In particular, we conclude from (4.7) that 



(4.11) 



EXe_ _ -^/(e) _ Xvf^ 

rf* rv^ ^^^^ 'T* 

eSDi •^'^0 -^fo e=3Di ■^'"-^ '^^1 



e3Di ^""-^ 



have the same law under IPDo,Di,eo- ^ 



Next, we present the connection between the interpolated measure and 
the random environment distribution. The normalizing constant ^do,di of the 
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interpolated measure turns out to be equal to the 1/4-moment estimated in 
the main lemma 2.5; see the left-hand side of (2.19). 

Lemma 4.5 (Relation between Pt,o,t,i,eo and Qvo,ea)- Let vo,vi gV be 
such that Assumption 2.3(c) holds. Then, for all cq € E, the measures Pi.o,Di,eo 
and Q^P^eo o,re mutually absolutely continuous with the Radon-Nikodym deriva- 
tive 

dV 1 /t \-^/^ 

-|^2) "-"^ VQ ,vi ,eo _ / -''t'l \ 

As a consequence, one has 



Proof. Let vq,vi and / be as in Assumption 2.3(c), and let cq G E. 
Using the definition of Pi,(,,t,i,eo and formulas (3.19) and (3.7) for the densities 

dQvi,eo/dpeo and dQ^^^eo/dpeo, we get 

dFvo,vueo _ 1 fdQv,,eo\ fdQ.,,eo\ 



, dpeo J \ dp 

(4.14) 

1 /z X^/Vx N^/^ 



We claim that z^^ = z^^ . Indeed, since / is an automorphism of the weighted 
graph (G, a) with /(fo) ="^1, we can use (4.9) to obtain 



'^v^Ax)peMx)= / ^voA{Xf{e))e(iE)Peoidx) 

(4.15) 

^voAx)pf-^{eo){dx)=Z^^- 



recall that these normalizing constants do not depend on the choice of the 
reference edge cq by Lemma 3.5(b). Thus, (4.12) follows from (4.14). 

Integrating (4.12) with respect to the probability measure Qvo,eo yields 
the second claim. □ 



Remark 4.6. The fact Z^Q.t,^ < oo, which was noted in Remark 4.2, and 
the identity (4.13) together imply EQ^^^^^[{xyJxi,J^/'^] < oo. 
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5. The key estimate in the proof of Lemma 2.5. Prom now on until the 
end of Section 7, we assume that Assumption 2.3 holds. 

In order to prove the main Lemma 2.5, it suffices by (4.13) to get good 
estimates for the normalizing constant Z^^^^^. In this section, we derive such 
an upper bound for Z^^^^^^. 

We introduce the following function of the random environment: 

1 



(5.1) 



-^vo,vi ('^) •" 



1 -^v 
Tlog — 

4; Xq; 



Lemma 4.5 allows us to write 
(5.2) P^Q^^j^^ep(dx) 



The following general variational principle is a cornerstone of this paper. 
Let V denote the set of all probability measures 11 on rig;, such that 11 and 
^vo,vi,eo mutually absolutely continuous and Eji[H^^^y^] and £'n[log((in/ 
.i^iieo)] ^^^6 finite. 



Lemma 5.1 (Variational principle). The functional 



(5.3) 



F:V 



is minimized for 11 : 
(5.4) 



p,eo G ^ with the value 

lv(i,eo) = log .Z^DQ^^-^ . 



log- 



dH 



Proof. We prove first that Q^o,eo ^ "P- By Lemma 4.5, Qt,o,eo and '^vQ,vi,eo 
are mutually absolutely continuous. To see that the expectation Eq^^_^^ [Hvo,vi] 
is finite, we use Theorem 2.4 in [8]. In the present context, this theorem 
states that for all edges e,e' G E, with respect to Q};Q,eo; the random vari- 
ables Xe/Xf,' have tails bounded by a power law. As a consequence, the law 
of Hy^^^y-^^{x) = log{xy^/xi,g) has exponentially bounded tails, that is. 



(5.5) 



lim sup — log (S 

A/^oo M 



tvo,eo 



log^ 



<^vo 



> M 



<0. 



This implies ^Q„g,,J|i^«o,^i l] < oo- 

Next, we show that Eq^^^^^ [log((iQ^()^eo/'^I'^i'o,t'i,eo)] is finite. The represen- 
tation (5.2) of Pi,o,i,i,eo implies 



(5.6) 



log 



logZ, 



vo,vi 



vo,vi ■ 



vo,vi,eo 



Prom Remark 4.2 we know that log.^t,Q^„^ is finite. Using (5.6) and 
^Q«o.'=o[l-^^'0'''il] < ^^^^ implies that \og{dQvo,eo/dPvo,vi,eo) has a finite 
expectation with respect to Qvo,eo- This completes the proof of Qup.eo ^ ^- 
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Taking the expectation of (5.6) with respect to Qvo.eo yields the claim 
FiQvo,eo) =log^^o,t;i as follows: 



(5.7) logZ^o,^! = -Eq^q^.q [Hvo,Vl] + EQ^o,eo 



log 



dl 



I'D, 1)1, eo 



We now prove that logZ^Q^t,^ is indeed the minimal value of the functional 
F. Let H (zV. We rewrite (5.6) in the following form: 



log^t,o,i)i = Hyg,vi + log 



(5.8) 



dF. 



vo,vi 



log 



DO,fl,eo 

dU 



dl 



log- 



dU 



DO,Di,eo "\£Do,eo 

Taking expectations with respect to IT, this implies 

dU 



(5.9) 



logZ^o,^, =F(n)-Sn 



log- 



£fO,eo 



recall the definition (5.3) of F. Now, the last relative entropy is nonnegative: 

dU 



(5.10) 



En 



log- 



This implies the claim F{Il) > \ogZ,, 



> 0. 

□ 



Before going into the details, let us intuitively and roughly explain how 
to get a good upper bound for logZ^j^^^,^. To apply the variational princi- 



ple, we need to construct an appropriate 11 = 11 



(7^) 

t'0, 1)1,60 



G V depending on a 



parameter 7 G R. On the one hand, 11 should be "close" to Qvo,eo to get 
the relative entropy in (5.10) small. On the other hand, we need to control 
i^(n). This requires us to control both, EnlHyg „J and the relative entropy 
En[log{dn/dF 

i'o,»)i,eo)]- choose n to be a "deformation" of P^,Q^t,^^eg. By 



this we mean that 11 is the law of a suitable random variable 



with respect to Fvo,vi,eo- We call si^'''^ the "deformation map." It depends 
on a deformation parameter 7 G M. 

The intuition behind our choice of the deformation map 'E^'^^ is as follows: 

(i) (i) 

In the case of large boxes Gr , for vq = and vi G Lr far away from the 
origin, roughly speaking, one expects that under Quo^eo? the weights of the 
edges close to vi are typically much smaller than the weights of the edges 
close to Vq. On the other hand, under the interpolated measure 



eo 



eo 



vo,vi,eo 1 



one 



might expect intuitively that the edge weights close to vq and close to vi 
are more or less of the same order of magnitude. This motivates us to define 
Heo'''^ below in such a way that it leaves the weights of the edges incident 
to Vq unchanged [see (5.14) below] and multiplies the weights of the edges 
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incident to vi by e"' [see (5.15) below]. For negative 7, this yields the desired 
behavior. 

Formally, the deformation map is defined as follows: 

Definition 5.2. Let vq, f 1, cq and <p be as in Assumption 2.3. For 7 G M, 
we define the map 

(5.11) E^^^^-.n^n, (xe)egi=; ^ (e^'^('^)xe),g^. 

As a consequence of Assumptions 2.3(b) and (d), {E'-^'P\x))eo — and, 
hence, E^'^'^^ maps to Oeo- We denote the restriction of E^'^'-''^ to by 

(5.12) r,^^*^^ : r^eo ~* ^eo ■ 

Let nlo^\,eo denote the distribution of Ei'^^'^^ under P„(,^t,j^eo- 

Let us state two important properties of the map E^"^^ : 

Lemma 5.3. For a// 7 G M and x G Oep, one has 

(5.13) (Hi7)(x))„^=x,„ and (E^^^^^x))^^ = e^x,,. 

Proof. Let x G r^eo- It follows from the properties of ip assumed in 
Assumptions 2.3(d) that 

(5.14) (H(7)(x))^ = xe foralle9?;o and 

(5.15) (5(7) (x))^ = e^xe for all e B vi. 

Summing (5.14) over all edges e incident to vq and (5.15) over all edges e 
incident to vi yields the claims in (5.13). □ 

Applying the variational principle (Lemma 5.1) with the measures LE^jQ^^j'^-i^^eo , 
we obtain the following upper bound: 

Lemma 5.4 (Key estimate). For all 7 G M, one has 



(5.16) logZ^Q^y-^<E (-,^) [i7„p_^J + _E (^.p) 



, aJ-^i)o,fi,eo 
d¥ 

vo,vi ,eo 



To prove this key estimate, we need to verify that Up^fJ^^eo € V for all 
7 G M. This requires some preparations. 
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We start by introducing additional notation. For 7 € M and x G 17, we set 
(5.17) x^''"^^ := ^ e^'^'^^^Xe for every vertex v ^V, 



(5.18) Yj^ (x) := Y[ (e'^'^^'^'^Xe) for every spanning tree T G T. 

eGT 

In the special case 7 = 0, we have x^'^^ = x„ and we abbreviate 

(5.19) y^(x):=y^°^)(x)=neeT^e. 

Lemma 5.5. For all 7 G M, the measures Yli^^J^^^eo and ^vo,vi,eo mu- 
tually absolutely continuous. The Radon-Nikodym derivative satisfies the 
following identity for pe^^-almost all x = {xe)e^E G ^^eo-' 

iog^^(H(r^(x)) 

(5.20) =^(^^ + l)_^^^(e)ae 

+ E ^log;^-ilog%^^|!^. 



In the remainder of this article, we work with this particular realization 

vo,vi,eo ■ 



of the Radon-Nikodym derivative dul^fj^^eo/d^' 



Proof of Lemma 5.5. By its definition, ^vo,vi,eo is absolutely contin- 
uous with respect to pe^- Consequently, since Il^'j^^-j^^eo is the law of ^^^^ 
under 'Pvo,vi,eo due to Definition 5.2, one has for any positive measurable 
function h : ~^ 

(5.21) 

/,(H(7)(^))^!jp£0(x)peo(rfx). 

The map Heg'^'* is invertible. Due to (5.14), e'^^'^^ leaves the weight Xeo of the 
reference edge cq 3 vq unchanged and it multiplies all other Xe with some 
e-dependent constant. Thus, sip"^^ leaves the reference measure p^Q invari- 
ant: /3eo [[^eo'''^]""'^^] = Peo[^] all measurable sets A C fig^. Consequently, 
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applying the transformation formula on the right-hand side of (5.21), we 
obtain 



(5.22) 



-'--'-110 ,1^1 , EQ 



[h] 



This implies that U^fJ^^^eo is absolutely continuous with respect to with 
the Radon-Nikodym derivative 



M-)%^([Hir^]~'(^))Peo(dx). 



(5.23) 



dn 



vo,vi,eo 



dp, 



eo 



dp, 



eo 



Using (3.12) and Lemma 4.5, it follows that both (iPt,p^t,j^eo/c^/Oeo and dIlti^vx,eQ/ 
dpeg are strictly positive on Qeo- Hence, the measures nig^^^eo and Pt,Q^^,^^eo 
are mutually absolutely continuous, and for pe„ -almost all x S ^cqj t^iG 
Radon-Nikodym derivative satisfies 



iog^^(4r^(x)) 



(5.24) 



log 



log 



'dFy 



vo,vi,eo ^■=h'p) (^^-^^ r!lHOiEl£o (s^'''¥')(x)) 
dpeo - dpeQ 



(iP. 



dpe 



(x) 



dF 



uPeo 



To get an explicit form for the last expression, we use Lemma 4.5 and (5.13) 
to obtain 



d 



(5.25) "^l^o.^-i.eo 



dp, 



eo 



'^''-'0 ■''^1 



e 'x 



VI 



L-l'O 



1/4, 



^(s(7)(x)). 

"Peo 



Next, we insert formulas (3.19) and (3.7) for dQyg^eo/dpeo and simplify the 
resulting expression using the abbreviations (5.17) and (5.18): 

i^^o.^Ji.eo (•;=;(7'P)(-^-)) 

dpeo " 



(5.26) 



a„(,/2+l/4, Na„i/2+l/4n 
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7K1/2+I/4) a,„/2+l/4 a„,/2+l/4 , f J7¥')^(a„+l)/2 ' 



For 7 = 0, Hir^Qeo 
X for all X. Hence, we obtain 

dP. 



J7eo is the identity map by Definition 5.2: H 



eo \ 



■ vo ,vi,eo ^^-j _ 



(5.27) 



g7Ki/2+V4) 



n 



vev\{fo,t'i} 



(7V) X {a„+l)/2 



ETer^T(a:) 



v(7<<')| 



x) 



Taking logarithms in the last formula, the claim follows from (5.24). □ 
Lemma 5.6. For all -f EM., one has 



(5.28) 



0<E, 



log 



jtt{7¥') 
"■^ tiO,fi,eo 



< 00. 



Proof. By Assumption 2.3, ip takes only values in [0, 1], so that e l"^' < 
g7'/'(e) < gl7l for all edges e and all 7 G R. This bound implies e~l'^lxt, < 
xl^'^) < el^lx^ and e-l^l-(l^l-i)yr(2;) < Y^^'<'\x) < e\^\<\^\-^^YT{x) for ah v G 
y and all T eT] here we use that every spanning tree T £T consists of 



|y| — 1 edges. Thus, using (5.20) and the fact that 



-eo 



is a bijection on 



f^eo , we get 



(5.29) sup 



log 



vo,vi,eo 



dl 



(x) 



: sup 



log 



dU 



-(sir(^)) 

vo,vi,eo 



dP '"'^o 



< 00. 



Hence, the expectation in (5.28) is finite. Note that this term is a relative 

entropy of nip^^j^eo with respect to ¥^^^^-^^^0'-, therefore, it is nonnegative. This 
completes the proof of the lemma. □ 



In the proof of nlo^\,eo 



G V, we need that the first expectation E (-y.^) y^^vo,vi\ 

arising in the upper bound of inequality (5.16) is finite. Later, for control- 
ling the right-hand side of the key estimate (5.16), we need the stronger 
statement that this expectation is linear in 7: 



Lemma 5.7. For all 7 G M, one has 



(5.30) 



J-UQ.i'l.eo 



1 
4' 
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Proof. Recall the definition (5.1) of H^^^^^. In tfie case 7 = 0, one fias 

r!"eo^\x) =x for all x and, consequently, nlpfj^^eo = ^VQ,vi,eo- 
grating (5.6) with respect to Puo,i'i,eo yields 



Hence, inte- 



X. 



DO 



logZ^Q^„^ — E] 



(5.31) 



log- 



fo,fi,eo 



> lOgZi;^,,;^ > -OO. 



log- 



and 



Here we used that the relative entropy of FvQ,vi,eo with respect to 
is non-negative. By Lemma 4.4, the random variables \og{xvi/xi,g 
log{xvo/xvi) = -log(3;„^/x^o) have the same law with respect to Wy^^y-^^eQ- 
Hence, all expectations in (5.31) are finite and, in particular, it follows that 



(5.32) 



Ev 



log^ 



Do 



0, 



which proves the claim in the case 7 = 0. 

For 7 G M, we use the definition of n^Q^i^^^eo as the law of 
^vo,vi,eo and the relations (5.13) to obtain 



^io''''' under 



1 

4^n 



"O.^l.^O 



log- 



(5.33) 



1 

—Ew 
—Ew 



log 



log 



('^ep'*^'^ (^))t'i 
{r}~ei^'^ {x))vQ 



e'x 



7 1 ^ 

- + -Sp 

4 4 '^f0>''l.<!0 



log 



''til 



I' DO 



7 
4' 



□ 



Now we are ready to prove the key estimate: 



Proof of Lemma 5.4. Let 7 G R. By the variational principle (Lemma 



5.1), it only remains to verify that H 



By Lemma 5.5, the measures H 



and P, 



Do,Di,eo 



are mutually absolutely 



continuous. Lemma 5.7 shows that the expectation E (~,^) [Hyg^^-^] is finite. 
The relative entropy E (j^) [log((inip^\,eo/cflF'Do,Di,eo)] is finite by Lemma 
5.6. This implies the claim hIq^^^eo G'P- D 
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6. Estimating the relative entropy. By Lemma 5.7, the first term in the 
key estimate (5.16) is linear in 7. The goal of this section is to prove the 
following quadratic bound in 7 for the second term in (5.16): 

Lemma 6.1 (Bound of the relative entropy). Suppose that Assumption 
2.3 holds. For all 7 G M, one has 



(6.1) E 

with Sy, defined in (2.20). 



log- 



dU 



{if) 



fo.t'i.eo 



< 



Before proving the lemma, let us introduce some notation. For 7 € M, set 



(6.2) 



5(7) ■=E 



log 



(7V) 



By the definition of nlg^^^eo (Definition 5.2), we have 3(7) = £^p„g_„j.e(, [f^y] 
with 



dn 



(if) 



(6.3) ^(x):=log- 

■ t)o,fi,eo 

for X G r^e,, . The idea for the bound of the relative entropy is to do a Tay- 
lor expansion of g around 7 = 0. First, we need to show that g is twice 
continuously differentiable. This will be done by showing that is twice 
continuously differentiable in 7 with derivatives which are bounded as func- 
tions of X. 

Recall the abbreviations (5.17) and (5.18). It will be convenient to use 
the following notation: For x G fiep, v , and 7 € M, consider e 1— ip{e) as 
a random variable on the space {e € -E : e 9 t;} equipped with the probability 
measure 

e^'P'y^')xe 

(6-4) l^x,v,^ ■■= — l^^^- 

e£E: 
eBv 

For any spanning tree T (^T, we abbreviate 
(6.5) A{T):=J2^{e). 

We consider the map A : T 1— > A(T) as a random variable on the space T of 
spanning trees equipped with the probability measure 



(6.6) 



2;, 7 



(if) 



(x) 



6t. 
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Lemma 6.2. For each x S r^eo; function 7 1-^ f'yix) is twice continu- 
ously dijjerentiable with the following derivatives: 



(6.7) 



veV\{vo,vi} 



(6-8) ^(^)= E ^Var,_(^)-ivar.,,,(A). 
veV\{vo,vi} 



Proof. Let x G Qeo - Using the definitions (5.17) and (5.18) of x[7'^^ and 
Y^^'^\x), respectively, we find that these two quantities are differentiable in 
7 with the foUowing derivatives: 

(6.9) 5-4^^^ = fie)e^^^''^xe and 

(6.10) ^Yp''\x) = J2 V>ie)Yp''\x) = AiT)Yp^\x). 

Hence, it follows from the explicit form of f-yix) given in (5.20) that 7 1— > 
f'yix) is continuously differentiable with 

§^(-) = ^ + l-E^(-K+ E ri^^ E v'(-)-^^^^^-e 

(6.11) 



iET6TA(r)y^ 



X) 



2 ET.rl^r^(x) 

Inserting the definition of the measures fJ-x,v,'y and i'x,'y gives (6.7). Differen- 
tiating (6.11) with respect to 7 yields the claim for the second derivative. 
□ 

Now we are ready to prove the bound of the relative entropy: 

Proof of Lemma 6.1. By Assumption 2.3, (p{e) G [0,1] for all e G 
and, hence, A(T) G [0, \E\] for all T . Thus, it follows from Lemma 6.2 
that 

(6.12) sup — ^(x) <oo 
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for j = 1,2. Consequently, 5(7) = -E'p„,j,„j,eo lAl twice continuously differ- 
entiable and the derivatives are obtained as expectations of the derivatives 
of /-y. Since 5(7) is a relative entropy by its definition (6.2), one has 5(7) > 

for all 7. Furthermore, g{0) = because Up^fJ^^eo = ^vo,vi,eo for 7 = 0. Thus, 
g'{0) = 0, and a Taylor expansion of g around yields 



(6.13) 

with 

(6.14) 



9(1) = / 9"{7)b -7)d^ 
Jo 



5^7 



To bound g" , we estimate the expression (6.8) for the second derivative of 
Since variances are nonnegative, we obtain for all 7 G M the bound 



(6.15) 



5|(x)<E^Var,_,(^) 

< max ((p(e) — ip(e'))^ 



■ Sip. 



Since the upper bound is independent of x and 7, the claim of the lemma 
follows from (6.14) and (6.13). □ 

7. Proof of the abstract version of the main lemma. In this section, we 
combine the results from Sections 4-6 to prove the abstract version of the 
main lemma: 



Proof of Lemma 2.5. Combining (4.13) with the key estimate (5.16) 
yields 



(7.1) logi^Q,^,,^ 



X \ 



< Emi^) [Hvo,Vi] + -E„(7V) 



log 



jtt(7V) 



vo,vi,eo 



for all 7 G M. To estimate the upper bound, we use Lemma 5.7 for the first 
term and the bound (6.1) of the relative entropy from Lemma 6.1 for the 
second term: 



(7.2) 



X. 



1/4- 



<1 + ^. 

-4 2 



This upper bound is minimal for 7 = —1/(45,^). Inserting this value for 7 
gives the bound 

1/4-1 

(7.3) logii;Q„^.,^ i^] < 



325. 



This proves the claim (2.19) of Lemma 2.5. □ 
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8. Application to finite boxes. In this section, we derive tlie "concrete 
version" of the main lemma (Lemma 2.2) from the "abstract version" (Lemma 
2.5). Given i € Lr (sufficiently far from the origin) and a sufficiently large 
box size i > io(-^) with io(^) introduced immediately before Lemma 2.2, we 
start by defining a specific function ip : Er^ — > [0, 1] as in Assumption 2.3(d) 
in the special case of finite boxes with periodic boundary conditions. Recall 
the definition of the "Dirichlet form" S^p in (2.20). We prove the following: 

Lemma 8.1. Let r G N with r > 130 and let the initial weight satisfy a G 
(0, (r — 129)/256). There exist constants Iq = lo{r, a) G N and ^ = ^(r, a) > 0, 
such that for all i £ Lr with \£\oo > Iq and i > io{i), there is a function 
if = Lff' : Er^ [0, 1] with the following properties: 

(a) Assumption 2.3 is fulfilled for the graph {V^E) = {yr^\E^'^) with con- 
stant initial weights a, the vertices f o = and vi = I, the reference edge 
eo = {0, (1,0)}, and the function (p. 

(b) The following hound holds: 



From now on, let r G N with r > 2. Only later, in the proof of Lemma 8.1, 
we need the stronger bound r > 130. 

Defining a function ip. For u' ^v' G L,. with \u' — v'\ = r, we call {u' ,v'} 
an r-edge. We say that an edge e = {u,v} G Er belongs to an r-edge {u' ,v'} 
if e C [u',v'], where denotes the straight line with end points u' and 

v' . For V £Vr, we call 



the level of the vertex, and we will also say that v is at level level(u). The 
definition of levels is illustrated in Figure 3. 

Before we define ip, we introduce an auxiliary function D: 

Definition 8.2 (Approximate Green's function). Given the two end 
points u,v gVt of an edge {u, v} G E^, we take the unique vertices u', v' G Lr 
and the unique numbers ju^jv £ {0,1,...,?^ — 1} such that the following 
hold: 

(a) {u' ,v'} is an r-edge, 

(b) 3u +jv = r-l and 



(8.1) 



1 



32(l + 01og(K|ooA)" 



(8.2) 



level(z;) := [|?;|oo/rl 



(8.3) 



u = 



—u H V and v 




r r 
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O....0'-0'"0'"0"0""0-0'"0-0'"0""0'"0"0-0'"0-p 




0....0...0~~0~~0""0""0-0""0'-0""0""0""0""0-0""0-0 



Fig. 3. There is precisely one vertex at level 0, namely, the origin 0, which is marked 
with a white square. The vertices at level 1 are marked with thick black dots, whereas the 
vertices at level 2 are marked with white circles. 



(0,0) 


1 « 

(3,0) 


1 

(6,0) 


(9,0) 




• 1 

< 


1 • • « 

1 « 










i2|2 




log 2 _|_ log 3 
2 2 ^™ 


log 3 




Fig. 4. The va 


ues of the function D 


on a piece of Gs ■ 





In particular, the straight line corresponding to the r-edge {u' ,v'} 

contains the straight line [u,u] corresponding to the edge {u,v}. We define 

(8.4) D{u,v) := ^^log(level(n') V 1) + log (level (u') V 1). 

r — 1 r — 1 

Interchanging the roles of u and v interchanges u' with v' and ju with jy. 
As a consequence, D{u,v) = D{v,u). Thus, D can be viewed as a function 
on undirected edges: 

(8.5) D:Er^[0,oo), D{{u,v}) := D{u,v). 



Remark 8.3. 

(a) The map D linearly interpolates on edges between two neighboring ver- 
tices in Lr', see Figure 4. 

(b) For a technical reason we multiply the first [respectively second] log in 
(8.4) by ju/ (r - 1) [respectively jy/{r - 1)] and not by (j„ + l/2)/r [re- 
spectively (^jy -|- l/2)/r]: This choice makes the function D constant on 
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all four edges incident to any vertex of degree 4. This feature is inherited 
by the function defined below. It is essential that this property holds 
for the vertices and i by Assumption 2.3(d). It is not an essential prop- 
erty for all other vertices of degree 4, but nice to have, because it makes 
the terms corresponding to these vertices cancel out when estimating 
5^; see the arguments leading to (8.9) below. 

For V gVt, define 

(8.6) D{v) := min D{e). 

Note that D{e) > for all i £ Lr with level (^) > 2. 

For fixed £ (z Lr, we next rescale and truncate D in such a way that it 
takes only values between and 1, and the value 1 is taken on all edges 
which have both endpoints on a level > level (^). 

We now use the identifications (2.3)-(2.5) of vertices/edges in finite boxes 
Gr^ with vertices/edges in the infinite graph Gr- Recall, in particular, the 
definition (2.4) of 0\ 

Definition 8.4. For ieU with D{i) >0,i> io{i), and e € Ei'\ define 

(8.7) ^(e):=^«(e):=|||Al if e € #\ 

and 93(e) := 1 for periodically closing edges e S Er^ \ Er\ 

Here is the motivation why to use this particular function ip: Recall that 
(fi needs to be chosen in such a way that the "Dirichlet form" S^p, defined 
in (2.20), gets small enough, as specified in (8.1). Given the constraints 
on if from Assumption 2.3(d), the Dirichlet form S^p is minimized for a 
certain two-point "Green's function." For our purposes, it suffices to use an 
approximation to this function having a roughly similar logarithmic decay. 
On the other hand, an arbitrary "Urysohn-type" function would in general 
not yield the required bound (8.1) of S,p roughly proportional to 1/log |^|oo- 

Proof of Lemma 8.1. We first verify Assumptions 2.3(a)-(d). Let 
r G N with r > 130 and a G (0, (r - 129)/256). Let i € U with |£|oo > and 
i ^ ^o(^)- Since r > 2, and i are not adjacent. Hence, Assumption 2.3(a) 
is satisfied. The reference edge cq = {0, (1,0)} is incident to 0; thus, 2.3(b) 
holds. Remark 2.4 shows that part (c) of the assumption holds. By definition. 
If takes only values in [0, 1]. To verify that part (d) of the assumption holds, 

(i) 

note that each edge e £ Er incident to belongs to an r-edge of the form 



30 



F. MERKL AND S. W. W. ROLLES 



{0,f } with f G Lr and level(f ) = 1. Hence, for all e G S^*'' with e 5 0, 
D{e) = and 93(e) = 0. Furthermore, for i > one has D(e) > D{^) for all 

e G E'^*^ adjacent to ^ and, thus, ip{e) = 1 for these edges. Thus, Assumption 
2.3(d) holds. This completes the proof of part (a) of the lemma. 

We now prove part (b) of the lemma. Let dy denote the vertex degree of 

(i) 

a vertex v in the graph Gr , that is, the number of edges incident to v in 

(i) 

Gr . Furthermore, let 

, , , , 2a + 1 

(8.8) a:=a{a):= — - — . 

(i) 

In the special case of the graph Gr and with our choice of if, for all vertices 
V of vertex degree dy = 4, that is, v G Lr \ we have ip{e) — ^p{e') = for all 

edges e,e & Er incident to v. Furthermore, all vertices in Vr have either 
degree 2 or 4. Hence, we get 

(8.9) 

By Remark 8.3, the function Er^ 3 ei—^ D{e) interpolates linearly between 
the values log(level(M') V 1) and log(level(i;') V 1) for edges e contained in 
the convex hull of an r-edge {u',v'}. As a consequence, for v G Vr^^ with 
level(f ) > level(£) + 1 and all edges e 3 v, one has D{e) > D{^)] recall the 
definition (8.6) of D.- This implies 99(e) = 1. Thus, we obtain 

< a ^ max I ip{e) — min (p{e') 



level(?;)<level(£) 



v£e' 



'Die) Die') 
^.10) = a y max ( „ , — min 



level(j;)<level(€) 



vde' 



= ^2 E max(Z)(e)-i2(^^))l 

level('u)<level(£) 

If e = {n, -y} G -Er is adjacent to a vertex G Lr, say, u = i' , then in the 
representation (8.3) for u and f , one has ju = and jy = r — 1. Hence, for 
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all e &Lr, 

(8.11) D{i') = log(level(/) V 1). 

Assume that v € Vr^^\L^'^ . Then, there exist precisely two edges e = {u, v} 
and e = incident to f, and both of them belong to the same r-edge. 

Let u' ,v' G Lr denote the endpoints of this r-edge as in (8.3). The definition 
(8.4) and (8.5) of D and (8.11) imply 



^.12) m&yi {D{e) - D{v)f 



D{u')-D{v') 



The convex hull [«', v'] of any r-edge e' = {u',v'} contains precisely r -|- 1 
vertices in Vr, where two among them belong to Lr- We get 

V- . , . , ..2 , J D{u') - Dlv'Y 2 

max {D{e) - D{v)f = (r - 1) ^ _ ' 

(8.13) 

mu')-D{v')f 
r-l 

This formula is the essential point where one can see why large values of r 
make recurrence easier to prove: Every r-edge contributes r — 1 summands; 
each of them scales proportional to l/(r — 1)^. Thus, every r-edge gives a 
contribution proportional to l/(r — 1), which gets small for large values of 
r. 

Inserting the expression (8.13) into (8.10), we obtain 

f8 14) c < « V mu')-D{v')? 
(8-14) < ^ E ^31 • 

{u,v'\r-cagc: 
lovol(u' ) ,level(?;' ) <level(£) 

Before going into the details, we explain the rough idea of the remainder 
of the proof: The summand corresponding to an r-edge {u' ,v'} in the sum 
in (8.14) is roughly of the order /~^(r — 1)~^ with / = level(u'). The number 
of r-edges on this level has roughly the size const • I. Thus, the contribution 
from edges on level I in the sum in (8.14) is roughly const • l~^{r — 1)~^. 
Thus, the whole sum [without the first factor a/Djyi)"^] has roughly the 
order of magnitude const • log(level(^))(r — 1)""^. The first factor in (8.14) 
equals a/(loglevel(£))^. Hence, we get an upper bound for S^p roughly of the 
size const/[(r — 1) loglevel(£)]. 

More precisely, we proceed as follows: Note that r-edges {n',f'} with 
level(u') = level(v') do not contribute to the sum in (8.14). Furthermore, 
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there are 4(2/ — 1) r-edges connecting points u' S with level(ti') = / to 
points v' S Lr with level(i)') = 1 — 1. Using (8.11), we obtain 



^.15) 



S < ^ 

(r-l)[log(level(£))]2 

level (£) 

X 4(2/-l)[log(/Vl)-log((/-l)Vl)]' 
1=1 



level(^) 



(r-l)[log(level(£))]2 
Applying the inequahty log x < x — 1 yields 

^ 2 lcvel(£) 



log 



l-l 



level (£) 

E (2^ - 1) 

1=2 



log 



/-I 



«=2 



/-I 



level(£)-l ^ levcl(f)-l ^ 



(8-16) =2 E 7+ E 12 

1=1 ' /=i ' 

<2[l + log(level(£))] +2 
Combining this with (8.15), it follows that 

8a[log(level(£)) +2] 



^.17) 



(r-l)[log(level(£))]2- 



Using the definition (8.8) of a and our assumption on the initial weight 
a, we get 

r — 1 r — 1 



(8.18) = ->1. 

^ ^ 256a 128(2a + l) 

Consequently, we can choose a constant c = c(r, o) € (0, 1) such that 



(8.19) 

holds. We set 
(8.20) 



cjr - 1) ^ 
256a 



^ ' ^ 256a 



By (8.19), ^ > 0. We choose lo{c) = lo{r,a) large enough that for all i £ Lr 
with l^loo >lo{c), one has 



^.211 



log(level(£))+2 ^ 
log(level(£)) - ^ ■ 
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Inserting this bound into (8.17) and using the definition of ^, we obtain 

(onn) o < 1 ^« I 

^ ^ c(r -l)log(level(£)) 32(1 + log(level(£)) ' 

Using the relation level (£) = |^|oo/'^ yields the claim of the lemma. □ 

Finally, we deduce the concrete version of the main lemma: 

Proof OF Lemma 2.2. Letr GNwithr> 130 and a G (0, (r-129)/256). 
By Lemmas 8.1 and 2.5, there exist constants Iq = Zo(r, a) G N and ^ = 
^(r, a) > 0, such that for all i Lr with \i\oQ > Iq and i > ioi^), one has 



^.23) K 



1/4- 



1 \ / r 
< exp — < 



32S^J-\\£\ooJ ■ □ 



9. Proving the main theorems. Now we are ready to prove the estimates 
for the hitting probabilities of the edge-reinforced random walk. 

Proof of Theorem 1.2. Given r and a as in the hypothesis of the 
theorem, take Iq = loir, a) and = ^(r, a) from Lemma 2.2. Let £ Lr with 
\£\oo ^ ^0- Fix any finite set 11 of finite paths in Gr starting in and ending 
in £, such that every path vr G 11 visits only once, namely, at its start, and 
visits also £ only once, namely, at its end. Take any i > io{£) large enough 
so that for all vr G IT and for all vertices v in it, the vertex v and all its 
neighboring vertices belong to Vr ■ Identifying Vr with a subset of , 

(i) 

we view 11 also as a set of finite paths in Gi- . 

For any admissible finite path n = {vo,vi, . . . , Vn) in Gr^ , let tt^ = {vn, ■ ■ ■ , 
vi,vo) denote its reversed path. We set 11*^ = {vr*^ : vr G 11}. Furthermore, let 
= {Xt = Vt for t = 0, . . . ,n} denote the event that the random walk {Xt)t 
follows the path vr as an initial piece of its trajectory. By a slight abuse of 
notation, we use this notation both for random walks on Gr and random 

walks on Gr \ Set = Uwen^Tr Stad, similarly, = UTren*^ 

Fix a collection of weights x G (0, cx))^'' ' . Let Qvo,x denote the law of the 
Markovian random walk on Gr^ starting in vq G Vr^^ as defined in (2.11) and 
(2.12). We are going to compare the laws and Q^^]. of the two random 
walks starting in and £, respectively: For a finite path vr = {vo,vi, . . . ,Vn) 
from Vq = to Vn = £ as above, we have 

n—l n 

(9.1) <[A.]=n^^=f^n^^=f^C[^H 

(=0 '^'t ^ t=l * 

and, thus, 

(9.2) <[^n] = ^Q«[^nH<^. 
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Trivially, we know Qo a;[^n] < 1 and, thus. 



X 1/4 



(9.3) QtiM<^^i<(^] 

Representing the reinforced random walk on Gr'^ with start in as a mixture 
of the Markovian random walks Qq^^ (Lemma 2.1), we conclude, using the 
claim (2.16) of Lemma 2.2 in the last step. 



(9.4) pI^IiAu] = E,^ [Q%[An\] < 



< 



1+f 



Now, the reinforced random walk in Gj. and the reinforced random walk m 

Gr with the same starting point and the same initial weights a have the 
same law up to the stopping time when the random walker leaves the graph 
{Vr^\Er^^). Since i was chosen large enough, depending on 11, this implies 



(9.5) pOr^[An]=Pg[An]<{-lA 



1+5 



Now let Ho/ denote the set of all finite paths in Gj. from to ^ that visit 
and I only once. We write IIo^^ as the union of an increasing sequence 
of finite subsets n„ | Hq/, n —* oo. Then as n — > oo, the events An„ also 
increase toward the event {r^ < tq} that the random walker hits I before 
returning to 0. We get 

(9.6) P^;, \n < to] = Jiin P^;^ [An J < 

which proves the first part of the theorem. 

To prove the second part, for / G N, let Ci denote the set of vertices i & Lr 
with \i\oo = rl. Observe that the first time the reinforced random walker 
starting at hits the set V; (provided this ever happens), it hits it in a 
vertex in £[. This implies the following bound for the probability that the 
edge-reinforced random walk visits the set Vi before returning to 0: 

(9.7) Po'Ja [^v, < to] = P^;, [re, <ro]<J2 <a in < to] ■ 

Since there are 8/ vertices in Lr with |£|oo = rl and hence in Ci, it follows 
from the first part of the theorem that 

(9.8) P^;,[rv, < to] < 8^(y)'^^ = 8r«. 
This concludes the proof of the theorem. □ 

Our estimates for the hitting probabilities imply recurrence: 
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Proof of Theorem 1.1. The edge-reinforced random walk on any 
infinite, locally finite, connected graph visits infinitely many points with 
probability one. In other words, it does not get "stuck" on a proper finite 
subgraph. This fact is, for example, remarked in [5], page 2. Here is the 
intuitive argument: Take two neighboring vertices v and v' . Conditional on 
the random walk visiting v the kih time at time t, the probability to be at v' 
at time t + 1 is at least as^^^^iy/ {a^ + 2k), which is not summable in k. Thus, 
the following implication holds almost surely by a Borel-Cantelli argument: 
if V is visited infinitely often, then v' is also visited infinitely often. 

Hence, the probability that the edge-reinforced random walk never returns 
to equals the probability that the random walker visits the sets Vi for all 
I before returning to 0. This shows that 



(9.9) 



oo 



]=pi 



Gr 

0,a 



U=l 



limPo^^[rv, <ro] 



By estimate 



■ oo 



^1.10) from Theorem 1.2, the last limit equals zero. Hence, 
= 0, which means that the edge-reinforced random walk returns 
to its starting point with probability one. By Theorem 2.1 of [8], this implies 
that the edge-reinforced random walk visits every vertex infinitely often with 
probability one. □ 



10. Conclusion. The technique used in this paper is quite robust to some 
perturbations of the model, but very nonrobust to other perturbations. More 
specifically: 

• The method of the proof in this paper could be adapted to the r-diluted 
versions of a large class of two-dimensional graphs with constant or pe- 
riodic initial weights, provided r is large. The graphs need to have suffi- 
ciently many reflection symmetries, as specified in Assumption 2.3. This 
includes, among others, the diluted versions of with additional diagonal 
edges added in a periodic and reflection-symmetric way. It also includes 
diluted versions of 7? x G, with any finite graph G with a transitive action 
of the automorphism group, for example, 7? x (ZmodA^Z). The abstract 
version of our main Lemma 2.5 is general enough to cover all these cases. 

• A variant of the method presented here was used in [7] to analyze the edge- 
reinforced random walk on a large class of one-dimensional graphs with a 
reflection symmetry. There, besides recurrence, exponential decay of the 
weights of the random environment was proven. The abstract version of 
our main Lemma 2.5 also covers these cases. In the one-dimensional setup, 
the law of the position of the reinforced random walk is tight uniformly 
in time with exponential tails. The proof of this fact is contained in [7]. 
Indeed, in one dimension, the 1/4- moment analog to (2.16) decays not only 
with a power law, but even exponentially fast. Furthermore, such a bound 
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holds also for the one-dimensional infinite- volume random environment. 
In the present paper, we do not treat a two-dimensional analog. 

• On the other hand, we cannot handle arbitrary initial weights with our 
method, as soon as one violates reflection symmetry. 

• The techniques of this paper break immediately down if one varies the re- 
inforcement scheme. They apply only to linear reinforcement. The method 
depends crucially on partial exchangeability of the linearly edge-reinforced 
random walk and, even more, on the specific form of the random environ- 
ment distribution as described in Lemma 3.4 and Definition 3.2. 

• The method presented here applies also to the original problem on 1? 
and yields bounds for the random environment distribution because the 
abstract version of the main lemma (Lemma 2.5) applies in this case as 
well. One could use this to derive bounds for the hitting probabilities 
in the style of Theorem 1.2, but weaker. However, using the variational 
principle in a different way [using Qt;i,eo instead of ^VQ,v^,eQ in the definition 
(5.3) of F\ and using more sophisticated deformation maps (defined in 
terms of a function as in Assumption 2.3, but additionally depending 
on the environment x), one can derive different and stronger bounds for 
the edge-reinforced random walk on 1? beyond the scope of this paper. 
This includes a fast decay of the expected logarithm of the weights of the 
random environment for small initial weights a. For more details, see [9], 
in particular. Theorem 2.3 in this reference. 

An important difference between the present paper and the previous work 
of [9] and [7] consists in the simplifying idea to prove recurrence directly from 
bounds on the environment on finite boxes without studying the random 
environment in infinite volume. 
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